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Abstract 

Objective: Neonatal sepsis (NS) is a common and life-threatening disorder in infants. Previous 
studies showed that interleukin-6 (IL-6) may be a valid non-invasive and rapid method for 
diagnosis of NS. We conducted this review to assess the validity of IL-6 for predicting NS. 

Methods: This was a systematic review with meta-analysis. Embase, Medline and Web of Science 
databases were searched between January 1990 and December 2009. The search terms used were 
"cytokine", "neonate", "sepsis" and "interleukin-6". We used standard methods recommended for 
meta analyses of diagnostic test evaluations. The analysis was based on a summary ROC (SROC) 
curve. Meta-regression analysis was used to assess the effects of some confounding factors on the 
results of meta-analysis. Potential presence of publication bias was tested using funnel plots and 
the Egger test. 

Findings: Meta-analysis was performed on 13 publications including 353 infants with sepsis and 
691 control infants. The pooled sensitivity and specificity of IL-6 was 0.79 and 0.84, respectively. 
The maximum joint sensitivity and specificity (i.e., the Q value) in SROC curve was 0.82 and the 
area under curve (AUC) was 0.89 (95% CI: 0.84-0.94). Meta-regression analysis showed that the 
diagnostic accuracy of IL-6 was not affected by confounding variables. The evaluation of 
publication bias showed that the Egger test was not significant (P=0.07). 

Conclusion: IL-6 seems to be a valid marker for predicting NS. It may be considered for early 
diagnosis of sepsis in neonatal care units. 
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Introduction 

Neonatal sepsis (NS) is a common and 
life-threatening disorder, especially in preterm 

Infants Up to 10% of infants have an infection 
in the first month of life PI. The rate of mortality 
and morbidity due to NS is very high t 1 * 2 !. 

The prognosis and outcome of NS depend on 
early diagnosis and on-time and efficient antibiotic 
therapy M. Diagnosis of neonatal infection may be 
the greatest and most difficult challenge for a 
neonatologist [ 3 L In most of NS patients, the 
clinical manifestations are non-specific in earlier 
stages thus rapid and non-invasive methods for 
diagnosis of the infected neonate is important in 
neonatal care 

Clinical judgment and laboratory tests such as 
complete blood cell count and the ratio between 
immature to total neutrophils (I/T ratio] showed 
to be useful in the early diagnosis of neonatal 
septic infection W. The microbiological cultures 
are the gold standard for diagnosis of neonatal 
sepsis but they are not available until at least up to 
72h and do not identify most infected infants t 1 ' 2 !. 

In recent years, chemokines and pro- 
inflammatory cytokines such as tissue necrosis 
factor-alpha (TNF-a), interleukin-6 (IL-6), IL-8 and 
pro-calcitonin (PCT) have been introduced as 
early markers in infected infants IL-6 is 
produced by monocytes, endothelial cells and 
fibroblasts W. The concentration of IL-6 rises 
rapidly after the onset of bacteremia, but its half 
life is short t 8 ' 9 !. Previous studies showed that IL-6 
may be a valid non-invasive and rapid method for 
diagnosis of NS t 8 ' 9 !. The role of IL-6 in diagnosis of 
NS was reviewed in 2000 ^ but it did not include 
meta-analysis and could not determine the 
quantitative value of IL-6 for diagnosis of NS. 

So, we conducted this systematic review and 
meta-analysis to assess the validity of IL-6 for 
predicting NS. 



Subjects and Methods 

Search strategy and study selection: 

The following electronic databases were searched 
between January 1990 and December 2009: 
Embase, Medline and Web of Science. The 



Cochrane Library also was reviewed to find 
relevant articles. 

The search terms used were "cytokine", 
"neonate", "sepsis" and "intrleukin-6". The 
reference lists from original and review articles 
were also searched. No language restrictions were 
considered. We excluded conference abstracts and 
letters to the journal editors because of the limited 
data presented in them. A study was included in 
the meta analysis when it was conducted on 
neonates (1-28 days old]. It consisted of at least 
two groups (culture positive sepsis group and 
control group); assessed the diagnostic value of 
IL6 in neonatal sepsis and provided enough data 
allowing test results to be extracted for individual 
study subjects. 

If an article did not include enough data for 
calculating sensitivity and specificity (two by two 
table] the corresponding author was asked to 
provide us necessary data. In case of no response 
from the corresponding author, a reminder was 
sent after 1 week. If necessary data was not 
available after this process, the study was 
excluded from meta-analysis. 

Studies conducted on special groups of 
neonates (neonates with metabolic disorders, 
hemodialysis, necrotizing enterocolitis and 
intraventricular hemorrhage) were excluded. All 
studies were checked by two reviewers 
independently. Disagreements were resolved by 
consensus. 

Data extraction and quality assessment: 

Data collected from the studies included 
participant characteristics, type of study, sample 
size, test methods, sensitivity and specificity data, 
cutoff values, publication year, and methodological 
quality. The numbers of true-positive, false- 
positive, false-negative, and true-negative results 
were extracted for each study. If no data on the 
above criteria was reported in the primary 
studies, we requested the information from the 
authors. 

We assessed the methodological quality of the 
studies using guidelines published by the quality 
assessment for studies of diagnostic accuracy 
(QUADAS) tool including 14 questions t 10 ]. 
Questions with "yes", "no" and "unknown" answer 
were scored as 1, -1 and 0, respectively, 
(maximum score, 14]. 
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Statistical Analysis: 

We used standard methods recommended for 
metaanalyses of diagnostic test evaluations t 11 !. 
Analyses were performed using STATA version 10 
and Meta-DiSc for Windows t 12 l. We computed the 
following measures of test accuracy for each 
study: sensitivity; specificity; positive likelihood 
ratio (PLR); negative likelihood ratio (NLR); and 
diagnostic odds ratio (DOR). The analysis was 
based on a summary ROC (SROC) curve [1U3]. 
Sensitivity and specificity for the single test 
threshold identified for each study were used to 
plot an SROC curve t 13 ' 14 !. A random-effects model 
was used to calculate the average sensitivity, 
specificity and other measures across studies t 15 ' 16 !. 

The term heterogeneity when used in relation 
to meta-analyses refers to the degree of variability 
in results across studies. We used the chi-square 
and Fisher exact tests to detect statistically 
significant heterogeneity. 

Meta-regression analysis was used to assess the 
effects of some factors on the results of meta- 
analysis. To assess the effects of these factors on 
the diagnostic ability of neonatal sepsis, we 
included them as covariates in univariate 
metaregression analysis (inverse variance 
weighted]. The following 5 covariates entered the 
meta-regression analysis: time of sepsis onset 
(late onset versus others); study quality 
(QUADAS>10 versus others); cut-off level for IL-6 
assay (>50 pg/ml versus others); control group 



status (healthy control versus others) and birth- 
weight of the neonates. Considering birth-weight, 
the neonates were divided into two groups. The 
first group consisted of neonates with very low 
birth-weight (VLBW) and the second one included 
neonates with low or normal birth-weight 
(others). 

The relative DOR (RDOR) was calculated 
according to standard methods to analyze the 
change in diagnostic precision in the study per 
unit increase in the covariate i 17 > 1Q ]. Since 
publication bias is of concern for metaanalyses of 
diagnostic studies, we tested for the potential 
presence of this bias using funnel plots and the 
Egger test t 19 l. 

Since the present study was a meta analysis that 
was based on published articles, to include the 
consents of patients and the approval of internal 
review boards was not applicable. 



Findings 

18 publications (No. 20-37) about the role of IL-6 
for predicting NS were considered to have 
eligibility criteria to be included in the study (Fig. 
1). We could not find enough data for analyzing 5 
of 18 studies (Nos. 27, 28, 32, 33 and 35), so, they 
were excluded. Finally, 13 publications including 
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Fig. 1. Flow diagram of the process of identifying and including references for the systematic review 
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Table 1: Characteristics of studies dealing with the role of IL-6 for predicting neonatal sepsis 



Study/ year 


Assay method 


Cut-off 
(pg/ml) 


Sensitivity 
(CI 95%) 


Specificity 
(CI 95%) 


DOR 

(CI 95%) 


Quality score 
(QUADAS) 


Buck et al/1994 1201 


ELISA 


10 


0.727 
(0.390- 0.940) 


0.778 
(0.644- 0.880) 


9.333 
(2.138- 40.750) 


8 


Ng et al/1997 [21] 


ELISA 


31 


0.886 
(0.733- 0.968) 


0.955 
(0.845- 0.994) 


162.75 
(28.009- 945.68) 


13 


Berner et al/1998 [22] 


Double 
sandwich EI A 


100 


0.875 
(0.710- 0.965) 


0.93 
(0.872- 0.968) 


93.333 
(26.806- 324.97) 


11 


Kuster et al/1998 1231 


ELISA 


25 


0.857 
(0.673- 0.960) 


0.85 
(0.621- 0.968) 


34 

(6.723- 171.94) 


13 


Dollner et al/2001 1241 


ELISA 


33 


0.818 
(0.482- 0.977) 


0.692 
(0.386- 0.909) 


10.125 
(1.466- 69.935) 


11 


Krueger et al/2001 1251 


ChllA 


80 


0.872 
(0.726- 0.957) 


0.902 
(0.837- 0.947) 


62.246 
(20.729- 186.92) 


14 


Martin et al/2001 [261 


ChllA 


160 


0.962 
(0.693- 1.000) 


0.69 
(0.454- 0.871) 


55.769 
(2.849- 1091.7) 


11 


Gonzalez et al/2003 1291 


ELISA 


18 


0.667 
(0.223- 0.957) 


0.81 
(0.581-0.946) 


8.5 

(1.131- 63.871) 


10 


Laborada et al/ 2003 [301 


Chll 


18 


0.756 
(0.597- 0.876) 


0.737 
(0.603- 0.845) 


8.68 
(3.442-21.890) 


12 


Santana Reyes et al/ 


ELISA 


30 


0.612 


0.803 


6.453 


13 


2003 1311 


(0.462- 0.748) 


(0.720- 0.871) 


(3.099- 13.439) 




Verboon-Maciolek et 


ChllA 


60 


0.676 


0.759 


6.548 


13 


al/2006 [34] 


(0.502- 0.820) 


(0.565- 0.897) 


(2.192- 19.556) 




Caldas et al/2008 1361 


ChllA 


25.8 


0.775 
(0.615-0.892) 


0.87 
(0.664- 0.972) 


22.963 
(5.537- 95.232) 


11 


Beceiro Mosquera et 


Lateral Flow 


53 


0.909 


0.806 


41.667 


9 


al/2009 [37] 


Immunoassay 


(0.587- 0.998) 


(0.625- 0.925) 


(4.434-391.56) 





IL: interleukin; DOR: Diagnostic odds ratio; QUADAS: Quality assessment for studies of diagnostic accuracy; 

ELISA: Enzyme-linked immunosorbent assay; ChllA: Chemiluminescence immunoassay; EIA= Enzyme immunoassay 

353 infants with sepsis and 691 control infants 
were analyzed. Table 1 shows summary data 
obtained from the studies. 

Charachteristics of the studies: 

In 4 of 13 studies, control groups included healthy 
neonates. The designs of 6 studies were case- 
control and the remaining 7 were cross-sectional. 
In all of 13 studies, both male and female neonates 
were included. Mean gestational ages were 32.1 
(range: 27.1-38.8) and 33.2 (range: 27.7-40) 
weeks in sepsis and control groups, respectively. 
Mean birth weights were 1780 (range: 904-3502) 
and 1927 (range: 1060-3628) grams in sepsis and 
non-sepsis neonates, respectively. 

Diagnostic accuracy: 

Table 1 and Fig. 2 show the results from included 
studies on sensitivity and specificity of IL-6 for 
predicting neonatal sepsis. PLR ranged from 2.66 
to 19.47 (pooled, 4.55; 95% CI: 3.27-6.32) while 
NLR ranged from 0.06 to 0.48 (pooled, 0.26; 95% 
CI: 0.18-0.36). The pooled value of DOR was 20.74 
with 95% CI of 10.83 to 39.7 (ranged from 6.45 to 
162.75). x 2 values of sensitivity, specificity, PLR, 



NLR and DOR were 22.45 (P=0.03), 32.27 
(P=0.001), 34.12 (P=0.001), 27.02 (P=0.008) and 
33.96 (P=0.001). 

We found that the SROC curve is positioned 
near the upper left corner of the curve, and that 



Fig. 2: Forest plot of estimates of sensitivity and 
specificity of IL-6 for predicting neonatal sepsis. 

•=point estimates of sensitivity and specificity from each 
study; error bars = 95% CIs; numbers= reference numbers of 
studies cited in the reference list. Pooled estimates were as 
follows: sensitivity, 0.79 [95% CI, 0.74 to 0.83); specificity, 0.84 
(95% CI, 0.81 to 0.87) 



Iran J Pediatr; Vol21(No 4); Dec 2011 



415 






Study estimate 


■ Summary point 




- HSRQC curvs 


95% confidence 






region 




95% prediction 






region 





Specificity 

Fig. 3: Summary ROC curve for assessment of the 
diagnostic accuracy of IL-6 to predict neonatal sepsis. 
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Fig. 4: Funnel plot for the assessment of potential 
publication bias in IL-6 assay. 

•=Each study in the metaanalysis; center line = SDOR. The 
result of the Egger test for publication bias was not significant 
[P= 0.07). 



We found that the SROC curve is positioned 
near the upper left corner of the curve, and that 
the maximum joint sensitivity and specificity (i.e., 
the Q value) was 0.82; and the area under curve 
(AUC) was 0.89 (95% CI: 0.84-0.94) (Fig. 3). 

Meta-regression analysis: 

The 5 covariates entered into the meta-regression 
did not have significant effect of the diagnostic 
accuracy of IL-6 (Table 2). 

The evaluation of publication bias showed that 
the Egger test was not significant (P=0.07). The 
funnel plots for publication bias also show no 
asymmetry (Fig. 4). These results indicate no 
potential for publication bias. 



Discussion 

This meta-analysis was conducted to assess the 
validity of IL-6 for predicting NS. The sensitivity of 
IL-6 assay ranged from 0.61 t 31 l to 0.96 t 26 l. Martin 
et al reported the specificity of IL-6 as 0.69, while 
it was as high as 0.95 in another study by Ng et al 
t 21 l. We found a wide range for DOR of IL-6 (8.5 to 
162.75). These differences in sensitivity, 
specificity and DOR of IL-6 for predicting NS may 
be due to various factors. Method of study, method 
of IL-6 assay, cut-off levels for IL-6 assay, neonates 
characteristics (e.g. birthweight) may be some 



possible explanations for the discrepancy. The 
discrepancy in some studies seemed to be due to 
low sample size t 22 * 38 !. 

The pooled values of sensitivity (0.79), 
specificity (0.84) and DOR (20.74) showed 
favorable accuracy of IL-6 for predicting NS. 
Laboratory examination in previous studies 
similarly suggested that IL-6 in the umbilical cord 
blood increases in newborn infants who 
developed sepsis [ 39 1. The Q value in SROC curve 
was 0.82 indicating high overall accuracy of IL-6 
for predicting NS. 

The results of meta-regression showed that the 
diagnostic accuracy of IL-6 for predicting NS was 
not affected by study quality, cut-off levels of IL-6 
assay, birth-weight of neonates and control group 
status. Our results also showed no significant 
publication bias. So, it can be concluded that the 
observed accuracy of IL-6 for predicting NS was 
not confounded by other variables and IL-6 may 
be considered as a promising marker for diagnosis 
of NS. The risks of blood sampling for IL-6 
assessment are minimal and restricted to the risks 
of blood sampling. The only relative 
contraindication of multiple blood sampling is 
anemia of prematurity t 6 l. Previous studies 
suggested that the small amount of blood sample 
required for cytokines assessment may not 
contribute significantly to the development of 
anemia t 38 l. The major limitation of IL-6 assay, 
especially manual methods, is the relatively long 
time as well as the interobserver error [ 4 °1. 
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Table 2: Metaregression analysis of the effects of some covariates on diagnostic precision of IL-6 for 

predicting neonatal sepsis 



Covariates 


Number 
of studies 


Coefficient 


RDOR (CI95%) 


P value 


Time of sepsis onset (late onset) 


4 


-0.26 


0.77 [0.15-3.83) 


0.72 


Study quality (QUAD AS >10) 


11 


0.98 


2.65 (0.28-25.1) 


0.5 


Cut-off level (>50 pg/ml) 


5 


-0.88 


0.41 [0.09-1.98) 


0.24 


Birth-weight (VLBW) 


3 


0.84 


2.31 (0.34-5.88) 


0.35 


Control group status (healthy controls) 


4 


0.06 


1.06 (0.18-6.14) 


0.94 



IL: interleukin; RDOR: Relative diagnostic odds ratio; QUADAS: Quality assessment for studies of diagnostic accuracy 
VLBW: Very low birth-weight 



However, newer automatic methods made the 
measurement of interleukins simpler and more 
accurate t 41 l. 



Conclusion 

In summary, IL-6 is a valid marker for predicting 
NS. It may be considered for early diagnosis and 
control of sepsis in neonatal care units. 
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